Tom Brady and Sofia Vergara are having a summer fling ... but they aren't dating, and it's not a romance ... TMZ has learned.
